A course exploring the fundamental connections between physics, information theory, and computation.
#information theory
Content tagged with "information theory"
The Physics of Information
The Bandwagon of Information Theory
A cautionary talk about the spread and misuse of information theory outside its proper domain. Famous for warning against overapplication.
Implementing Information Theory in Python
A practical guide to implementing entropy calculation and data compression using Python.
Information Theory and Machine Learning
Exploring the connections between information theory and the emerging field of machine learning. Published in the IRE Transactions.
Information Theory and Biology
Exploring the application of information theory to biological systems and genetics, pioneering the field of bioinformatics.
A Mathematical Theory of Communication
The seminal paper that established information theory as a new field of study. Introduced the concept of entropy and channel capacity.